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Abstract 



Levy and Solomon have found that random multiphcative processes wt = 
AiA2...At (with Xj > 0) lead, in the presence of a boundary constraint, to a 
distribution P{wt) in the form of a power law w^^^'^^\ We provide a simple 
exact physically intuitive derivation of this result based on a random walk 
analogy and show the following: 1) the result applies to the asymptotic {t oo) 
distribution of Wt and should be distinguished from the central limit theorem 
which is a statement on the asymptotic distribution of the reduced variable 
-^{log Wt — {log Wt)); 2) the two necessary and sufficient conditions for P{wt) 
to be a power law are that (logAj) < (corresponding to a drift wt 0) 
and that wt not be allowed to become too small. We discuss several models, 
previously thought unrelated, showing the common underlying mechanism for 
the generation of power laws by multiplicative processes: the variable log wt 
undergoes a random walk biased to the left but is bounded by a repulsive 
"force". We give an approximate treatment, which becomes exact for narrow 
or log-normal distributions of A, in terms of the Fokker-Planck equation. 3) 
For all these models, the exponent fi is shown exactly to be the solution of 
(A'^) = 1 and is therefore non-universal and depends on the distribution of A. 
4) For finite t, the power law is cut-off by a log-normal tail, reflecting the fact 
that the random walk has not the time to scatter off the repulsive force to 
diffusively transport the information far in the tail. 

Levy et Solomon out montre qu'un processus multiplicatif du type wt = 
AiA2...At (avec Xj > 0) conduit, en presence d'une contrainte de bord, a une 

distribution P{wt) en loi de puissance w^^^'^^\ Nous proposons une derivation 
simple, intuitive et exacte de ce resultat basee sur une analogic avec une 
marche aleatoire. Nous obtenons les resultats suivants: 1) Ic regime de loi 
de puissance decrit la distribution asymptotique de wt aux grands temps et 
doit etre distingue du theoreme limite central decrivant la convergence de la 
variable reduite -^{log wt — (logwt)) vers la loi gaussienne; 2) les deux condi- 
tions necessaires et suffisantes pour que P{wt) soit une loi de puissance sont 
(log Xj) < (correspondant a une derive vers zero) et la contrainte que wt soit 
empechee de trop s'approcher de zero. Cette contrainte pent etre mise en oeu- 
vre de maniere variee, generalisant a unc grande classe de modeles le cas d'une 
barriere reflechissante examine par Levy ct Solomon. Nous donnons aussi une 
traitement approximatif, devenant exact dans la limite oii la distribution de 
A est etroite ou log-normale en terme d'equation de Fokker-Planck. 3) Pour 
tous CCS modclcs, nous obtenons le resultat general exact que I'exposant fi est 
la solution dc I'cquation (A^) = 1. /i est done non-universel ct depend de la 
specificite de la distribution de A. 4) Pour des t finis, la loi de puissance est 
tronquee par une queue log-normale due a une exploration finie de la marche 
aleatoire. 

Short title: Constrained convergent multiplicative processes 

PACS: 05.40-|-j : Fluctuations phenomena, random processes and brownian 
motion 

64.60.Ht : Dynamical critical phenomena 

05.70.Ln : Nonequilibrium thermodynamics, irreversible processes 
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1 Introduction 



Many mechanisms can lead to power law distributions. Power laws have a special 
status due to the absence of a characteristic scale and the implicit (to the physicist) 
relationship with critical phenomena, a subtle many-body problem in which self- 
similarity and power laws emerge from cooperative effects leading to non-analytic 
behavior of the partition or characteristic function. 

Recently, Levy and Solomon have presented a novel mechanism based on ran- 
dom multiplicative processes: 

wt+i = XtWt, (1) 

where At is a stochastic variable with probability distribution n(At) and we express 
Wt in units of a reference value Wu which could be of the form e'^*, with r constant. 
All our analysis below then describe the distribution of Wt normalized to Wu, in other 
words in the "reference frame" moving with Wu- At the end, we can easily make 
reappear the scale Wu by replacing everywhere w hj 

Taken litterally with no other ingredient, expression (|l]) leads to the log-normal 
distribution P, ^ Indeed, taking the logarithm of (|I|), we can express the dis- 
tribution of log 1(7 as the convolution of t distributions of log A. Using the cumulant 
expansion and going back to the variable Wt leads, for large times t, to 



Piwt) = , — exp 



(logwt-vt)'^ 



2Dt 



(2) 



where v = (log A) = /q°° (iAlog An(A) and D = ((logA)^) — (logA)^. Expression 
can be rewritten 



P(wt) = / J, e^^"*)"* (3) 



with 



/^M = ^log^. (4) 



Since fi{wt) is a slowly varying function of Wt this form shows that the log-normal 
distribution can be mistaken for an apparent power law with an exponent /i slowly 
varying with the range Wt which is measured. Indeed, it was pointed out ||^ that 
for Wt « e'-^"*"^'^''*, fi{wt) « 1 and the log-normal is undistinguishable from the ^ 
distribution, providing a mechanism for 1/f noise. However, notice that fi{wt) oo 
far in the tail Wt» e^'"'^'^^^^ and the log-normal distribution is not a power law. 

The ingredient added by Levy and Solomon is to constrain Wt to remain larger 
than a minimum value wq > 0. This corresponds to put back wt to wq as soon as it 
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would become smaller. To understand intuitively what happens, it is simpler to think 
in terms of the variables Xt = log Wt and / = log A, here following Then obviously, 
the equation (|l]) defines a random walk in x-space with steps / (positive and negative) 
distributed according to the density distribution 7i{l) = e'n(e'). The distribution of 
the position of the random walk is similarly defined: V{xt,t) = e^*P(e^*,t). 

• If f = (/) = (log A) > 0, the random walk is biased and drifts to +00. As 
a consequence, the presence of the barrier has no important consequence and we 
recover the log-normal distribution (^ apart from minor and less and less important 
boundary effects at xq = logwo, as t increases. Thus, this regime is without surprise 
and does not lead to any power law. We can however transform this case in the 
following one f = (/) < but a suitable definition of the moving reference scale 
Wu ~ e^* such that, in this frame, the random random drifts to the left. But the 
barrier has to stay fixed in the moving frame, corresponding to a moving barrier in 
the unsealed variable Wt- 

• li V = (l) < 0, the random walk drifts towards the barrier. The qualitative 
picture is the following (see figures 1 and 2): a steady-state (t 00) establishes 
itself in which the net drift to the left is balanced by the reflection on the reflecting 
barrier. The random walk becomes trapped in an effective cavity of size of order 
^ with an exponential tail (see below). Its incessant motion back and forth and 
repeated reflections off the barrier and diffusion away from it lead to the build-up of 
an exponential probability (concentration) profile (and no more a gaussian), as we 
are now going to establish, leading in the initial Wt variable to the announced power 
law distribution. 

2 The random walk analogy 

In the Xt = logwt and k = log At variables, expression (|I|) reads 

xt+i =xt + k, (5) 

and describes a random walk with a drift (/) < to the left. The barrier at Xq = log 
ensures that the random walk does not escape to —00. This process is described by 
the Master equation ||l[] 

/+00 
Ti{l)V{x-l,t)dl. (6) 
-00 



4 



2.1 Pert ur bat ive analysis 

To get a physical intuition of the underlying mechanism, we now approximate this 
exact Master equation by its corresponding Fokker-Planck equation. Usually, the 
Fokker-Planck equation becomes exact in the limit where the variance of 7r(/) and 
the time interval between two steps go to zero while keeping a constant finite ratio 
defining the diffusion coefficient In our case, this corresponds to taking the limit 
of very narrow 7r(/) distributions. In this case, we can expand V{x — l, t) up to second 
order 

dV 1 d'^V 

V{x -l,t) = Vix,t) - + f^\i.,t) 

leading to the Fokker-Planck formution 

dV{x,t) _ dj{x,t) _ ^ dV{x,t) ^ ^ d^V{x,t) 
dt dx dx dx"^ ' 

where v = (/) and D = {P) — (/)^ are the leading cumulants of n(logA). j{x,t) is 
the flux deflned by 

j{x,t)=vPix,t)-D^^^^. (8) 

Expression (|^ is nothing but the conservation of probability. It can be shown that 
this description (|^) is generic in the limit of very narrow vr distributions: the details of 
TT are not important for the large t behavior; only its flrst two cumulants control the 
results [|]. V and D introduce a characteristic "length" x = j^. In the overdamped 
approximation, we can neglect the inertia of the random walker, and the general 
Langevin equation = —7^ + F + Ffi^ct reduces to 

^ = v + vit), (9) 

which is equivalent to the Fokker-Planck equation (|^)? rj is a noise of zero mean and 
delta correlation with variance D. This form examplifles the competition between 
drift V = —\v\ and diffusion T]{t). 

The stationary solution of (|^), ^^q/'' = 0, is immediately found to be 

VUx) = A--e-^'\ (10) 
/i 



with 



A and B are two constants of integration. Notice that, as expected in this approxima- 
tion scheme, /i is the inverse of the characteristic length x. In absence of the barrier. 
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the solution is obviously A = B = leading to the trivial solution Poo{x) = 0, which 
is indeed the limit of log- normal form (Q) when t — oo. In the presence of the barrier, 
there are two equivalent ways to deal with it. The most obvious one is to impose 
normalization 

/ Voo{x)dx = l, (12) 

where Xq = logwo- This leads to 

Poo(x) =/ie-^("-^o), (13) 

Alternatively, we can express the condition that the barrier at Xq is reflective, namely 
that the the flux j(xo) = 0. Let us stress that the correct boundary condition is 
indeed of this type (and not absorbing for instance) as the rule of the multiplicative 
process is that we put back Wt to Wq when it becomes smaller than wq, thus ensuring 
Wt > Wq. An absorbing boundary condition would correspond to kill the process when 
Wt < Wq. Reporting (0) in (H) with j(xo) = 0, we retrieve ([T3| ) which is automatically 
normalized. Reciprocally, ([T3|) obtained from (|1^) satisfies the condition j{xQ) = 0. 

There is a faster way to get this result (|T3|) using an analogy with a Brownian 
motion in equilibrium with a thermal bath. The bias (Z) < corresponds to the 
existence of a constant force — |f | in the —x direction. This force derives from the 
linearly increasing potential V = \v\x. In thermodynamic equilibrium, a brownian 
particle is found at the position x with probability given by the Boltzmann factor 
fjj-^jg jg exactly ( [T3| ) with D = as it should from the definition of the random 
noise modelling the thermal fluctuations. 

Translating in the initial variable Wt = e^, we get the Paretian distribution 

PooiWt) = (14) 



1+M ' 



with /i given by ([TT]): 



^ ((logA)2)-(logA)2- ^ ' 

These two derivations should not give the impression that we have found the exact 
solution. As we show below, it turns out that the exponential form is correct but the 
value of fi given by (|T5|) is only an approximation. As already stressed, the Fokker- 
Planck is valid in the limit of narrow distributions of step lengths. The Boltzmann 
analogy assumes thermal equilibrium, i. e. that the noise is distributed according to 
a gaussian distribution, corresponding to a log- normal distribution for the A's. These 
restrictive hypothesis are not obeyed in general for arbitrary n(A). 
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2.2 Exact analysis 

In the general case where these approximations do not hold, we have to address the 
general problem defined by the equations (H) and (||). Let us consider first the case 
where the barrier is absent. As already stated, the random walk eventually escapes 
to —oo with probability one. However, it will wander around its initial starting point, 
exploring maybe to the right and left sides for a while before escaping to — oo. For 
a given realization, we can thus measure the rightmost position Xmax it ever reached 
over all times. What is the distribution Vmax{Max{0, Xmax))"^ The question has been 
answered in the mathematical litterature using renewal theory (0, p. 402) and the 
answer is 

P™„,((Max(0, Xrnax)) ~ e-'^"— , (16) 



with n given by 



/+00 r+oo 
7r(/)e^'rf/ = / n{\)ydX = 1. (17) 
-oo JO 



The proof can be sketched in a few lines and we summarize it because it will 
be useful in the sequel. Consider the probability distribution function M{x) = 

J-oo'Pmax{Xmax)dXmax, that Xmax < X. Starting at the Origin, this event Xmax < X 

occurs if the first step of the random walk verifies Xi = y < x together with the 
condition that the rightmost position of the random walk starting from —Xi is less 
or equal to x — y. Summing over all possible we get the Wiener-Hopf integral 
equation 

M{x -y)TT{y)dy. (18) 

-oo 

It is straightforward to check that M{x) e~^^ for large x with /i given by (p^Tj) . 
We refer to for the questions of uniqueness and to ||, |] for classical methods 
for handling Wiener-Hopf integral equations. We shall encounter the same type of 
Wiener-Hopf integral equation in section 3.3 below which addresses the general case. 

How is this result useful for our problem? Intuitively, the presence of the barrier, 
which prevents the escape of the random walk, amounts to reinjecting the random 
walker and enabling it to sample again and again the large positive deviations de- 
scribed by the distribution ([T6|) . Indeed, for such a large deviation, the presence of 
the barrier is not felt and the presence of the drift ensures the validity of (|1^) for 
large x. These intuitive arguments are shown to be exact in section 3.3 for a broad 
class of processes. 

Let us briefiy mention that there is another way to use this problem, on the 
rightmost position Xmax ever reached, to get an exponential distribution and therefore 



7 



a power law distribution in the Wt variable. Suppose that we have a constant input 
of random walkers, say at the origin. They establish a uniform flux directed towards 
— oo. The density (number per unit length) of these walkers to the right is obviously 
decaying as given by (|16D with ([17|). This provides an alternative mechanism for 
generating power laws, based on the superposition of many convergent multiplicative 
processes. 

Let us now compare the two results ([15|) and ([17|) for /i. It is straightforward to 
check that (^) is the solution of (0) when 7r(/) is a gaussian i.e. n(A) is a log-normal 
distribution. (p!5D can also be obtained perturbatively from (0): expanding e^^ as 
e^'' = 1 + fil + ^fi^l"^ + ... up to second order, we find that the solution of (|l^ is (pTS]). 
This was expected from our previous discussion of the approximation involved in the 
use of the Fokker-Planck equation. 

2.3 Relation with Kesten variables 

Consider the following mixture of multiplicative and additive process: 

5-^+1 = bt + XtSt, (19) 
with A and b are positive independent random variables. The stochastic dynamical 



process (|T9D has been introduced in various occasions, for instance in the physical 



modelling of ID disordered systems |jTO[ and the statistical representation of financial 



time series [11]. The variable S{t) is known in probability theory as a Kesten variable 
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Notice that 6 = recovers (|1|). It is well-known that for (log A) < 0, S{t) is 
distributed according to a power law 

p{St) ~ s;^'^'\ (20) 



with /i determined by the condition ([T7|) already encountered above (A^) = 1. In 
fact, the derivation of (pO]) with (p^Tf) uses the result (O) of the renewal theory of large 



positive excursions of a random walk biased towards — oo |TT]]. The figure 3 shows the 
reconstructed probability density of the kesten variable St for A^ and bt uniformely 
sampled in the interval [0.48; 1.48] and in [0, 1] respectively. This corresponds to the 
theoretical value fi ~ 1.47. We have also constructed the probability density function 
of the variations St+i — St of the kesten variable for the same values. We observe again 
a powerlaw tail for the positive and negative variations, with the same exponent . 
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This is not by chance and we now show that the multiphcative process with the 
reflective barrier and the Kesten variable are deeply related. First, notice that for 
(log A) < in absence of b{t), St would shrink to zero. The term b{t) can be thought 
of as an effective repulsion from zero and thus acts similarly to the previous barrier 
Wo- To see this more quantitatively, we form 



St+i — St bt 



+ Ai-1, (21) 



St St 

We make the approximation of writing the finite difference as ^^^f^- It 

has the same status as the one used to derive the Fokker-Planck equation and will 
lead to results correct up to the second cumulant. Introducing again the variable 
X = log S, expression (^) gives the overdamped Langevin equation: 

-^ = b{t)e-^-\v\+r^{t), (22) 

where we have written \(t) — 1 as the sum of its mean and a purely fluctuating part. 
We thus get = (A) - 1 ~ (log A) and D = {if) = (A^) - (A)^ - (log(A)2) - (logA)^. 
Compared to (H), we see the additional term b(t)e~^, corresponding to a repulsion 
from the x < region. This repulsion replaces the reflective barrier, which can 
itself in turn be modelled by a concentrated force. The corresponding Fokker-Planck 
equation is 

^ . me-'Pi. - (. . me")?^ . O?^. (23) 

It also presents a well-deflned stationary solution that we can easily obtain in the 
regions x +oo and x — oo. In the flrst case, the terms b{t)e~^ can be neglected 
and we recover the previous results (0) with xq now determined from asymptotic 
matching with the solution at a; — oo. For x — * — oo, we can drop all the terms 
except those in factor of the exponentials which diverge and get P{x) e^. Back in 
the Wt variable, Poo{St) is a constant for St and decays algebraically as given by 



([T^) with the exponent (|TT|,[T5|) for St +oo. 

Beyond these approximations, we can solve exactly expression ( pT]) or equivalently 
(P!^ ) and we recover (|T7p. This is presented in section 3.3 below. Again, notice that 
( pn]JT3| ) is equal to the solution of (|T^ up to second order in the cumulant expansion 
of the distribution of log A. 

It is interesting to note that the Kesten process (|T9D is a generalization of branch- 



ing processes |13|. Consider the simplest example of a branching process in which 



a branch can either die with probability po or give two branches with probability 
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P2 = 1 — po- Suppose in addition that, at each time step, a new branch nucleates. 
Then, the number of branches St+i at generation t + 1 is given by eq.(^) with bt = I 
and Xt = ^"^^5 where jt+i is the number of branches out of the St which give two 
branches. The distribution n(A) is simply deduced from the binomial distribution 
of namely (/; Jpr^pf'-^'^^ = [s.^.l'^y.^^i Pl^^'pl''''^' ■ For large St, U{X) is 
approximately a gaussian with a standard deviation equal to ^sl^zEsl^ ^_g, it goes 
to zero for large St. We thus pinpoint here the key difference between standard 
branching processes and the Kesten model: in branching models, large generations 
are self-averaging in the sense that the number of children at a given generation 



fluctuates less and less as the size of the generation increases, in contrast to eq. ([T9|) 
exhibiting the same relative fluctuation amplitude. This is the fundamental reason 
for the robustness of the existence of a power law distribution in contrast to branch- 
ing models in which a power law is found only for the special critical case po = p2 
at the edge of the run away condition. The same conclusion carries out directly for 
more general branching models. Note finally that it can be shown that the branching 
model previously defined becomes equivalent to a Kesten process if the number of 
branches formed from a single one is itself a random variable distributed according to 
a power law with the special exponent = 1, ensuring the scaling of the fluctuations 
with the size of the generations. 

2.4 Generalization to a broad class of multiplicative process 
with repulsion at the origin 

The above considerations lead us to propose the following generalization 

wt+i = e^('""^^"^-»AtWi, (24) 

where /(wi, {Xt, h, ...})) ^ foi wt ^ oo and f{wt, {Xt, h, ...})) —> oo for vot 0. 

The model (P is the special case f{wt,{Xt,bt,...}) = for Wt > Wq and 
f{wt,{Xt,bt,...}) = log(^^) for Wt < Wq. The Kesten model (|19D is the special 
case f{wt,{Xt,bt,...}) = log(l + j^)- More generally, we can consider a process 
in which at each time step t, after the variable At is generated, the new value XtWt 
(or XtWt + bt in the case of Kesten variables) is readjusted by a factor e-'^*^"'*''^'^*'''*'---^') 
reflecting the constraints imposed on the dynamical process. It is thus reasonable to 
consider the case where f{wt, {Xt, bt, ...}) depends on t only through the dynamical 
variables Xt (and in special cases bt), a condition which already holds for the two 
examples above. In the following Fokker-Planck approximation, we shall consider 
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the case where f{wt, {Xt,bt,...}) is actually a function of the product XtWt, which is 
the value generated by the process at step t and to which the constraint represented 
by f{\tWt) is applied. We shall turn back to the general case ( p4D in section 2.5. 

In the Fokker-Planck approximation, f{XtWt) defines an effective repulsive 
stochastic force. To illustrate the repulsive mechanism, it is enough to consider the 
restricted case where f{wt) is only a function of Wf. This corresponds to freezing the 
random part in the noise term leading to the definition of the diffusion coefficient. 
In the random walk analogy, we thus have the force F{xt) = f{wt) acting on the 
random walker. The corresponding Fokker-Planck equation is 

dV{x,t) _ d{v + F{x))V{x,t) ^ ^ d^V{x,t) ^25) 
dt dx dx'^ 

F{x) decays to zero at x ^ oo and establishes a repulsion of the diffusive process 
in the negative x region: this is the translation in the random walk analogy of the 
condition f{wt) — > oo for Wt — > 0. 

With these properties, the tail of V{x) for large x and large times is given by 
'Poo{x) ~ e~^^, and as a consequence Wt is distributed according to a power law, with 
exponent fi given again approximately by (11,15). The shape of the potential defined 
hy V + F{x) = — ^ g^^'* , showing the fundamental mechanism, is depicted in figure 4. 
As we have already noted, the bound Wq leading to a reflecting barrier is a special 
case of this general situation, corresponding to a concentrated repulsive force at xq. 

The expression (^) for the general model can be " derived" from the overdamped 
Langevin equation equivalent to the Fokker-Planck equation (p5|): 

^ = F{x)-\v\+r]{t). (26) 

Let us take the discrete version of (|26| ) as Xt+i = Xt + F{xt) — |^| + Vt, replace with 
Xt = logwt and exponentiate to obtain 



Wt+l 



eF(iog«,.)^^^^^ (27) 



where Xt = e~'"'"^^*. Since F{x) for large Wt, we recover a pure multiplicative 
model Wt-^-i = XfWt for the tail. The condition that F{x) becomes very large for 
negative x ensures that Wt cannot decrease to zero as it gets multiplied by a diverging 
number when it goes to zero. 

2.5 Exact derivation of the tail of the power law distribution 



The existence of a limiting distribution for Wt obeying (^4]), for a large class of 
f{w,{X,b,...}) decaying to zero for large w and going to infinity for w — > 0, is 
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ensured by the competition between the convergence of w to zero and the sharp re- 
pulsion from it. We shall also suppose in what follows that df{w, {A, b, ...}) /dx 
for w ^ oo, which is satisfied for a large class of smooth functions already satisfying 
the above conditions. It is an interesting mathematical problem to establish this 
result rigorously, for instance by the method used in |jl|, 0. Assuming the existence 
of the asymptotic distribution P{w), we can determine its shape, which must obey 

V = we-f^""'^^'"--^^ = Xw, (28) 

where {X,b, ...} represents the set of stochastic variables used to define the random 
process. The expression (^) means that the l.h.s. and r.h.s. have the same distri- 
bution. We can thus write 

P,{v) = / dXU{X) / dwPUw)6{v -Xw)= n(A)P^(-). 
Jo Jo Jo X X 

Introducing V = logv, x = logw and I = log A, we get 

/ + 00 
dm{l)P^{V-l), (29) 
-oo 

Taking the logarithm of (|28|) , we have V = x — f{x, {X,b, ...}), showing that 
V ^ X for large x > 0, since we have assumed that f{x, {X,b, ...}) for large 
X. We can write PiV)dV = P,{x)dx leading to P{V) = ^_9f^:^[lJ%e, ^ P.iV) 
for a; oo. We thus recover the Wiener- Hopf integral equation ([T8| ) yielding the 
announced results (|1^ with ( [T7| ) and therefore the power law distribution (|T^ for wt 
with fi given by (|T^. 

This derivation explains the origin of the generality of these results to a large class 
of convergent multiplicative processes repelled from the origin. 

3 Discussion 

3.1 Nature of the solution 

To sum up, convergent multiplicative processes repelled from the origin lead to power 
law distributions for the multiplicative variable Wt itself. Ideally, this holds true 
in the asymptotic regime, namely after an infinite number of stochastic products 
have been taken. This addresses a different question than that answered by the 
log-normal distribution for unconstrainted processes which describes the convergence 
of the reduced variable ^(logwt — {log Wt)) to the gaussian law. Notice that this 
reduced variable tends to zero for our problem and thus does not contain any useful 
information. 
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3.2 The exponent /i 

In the Fokker-Planck approximation of the random walk analogy, fi is the inverse of 
the size of the effective cavity trapping the random walk. In this approximation, fi 
is a function of, and only of, the first two cumulants of the distribution of log A. In 
particular, if the drift |f | < 2D, fi < 2 corresponding to variables with no variance 
and even no mean when < 1 (|f | < It is rather intuitive: large fluctuations in A 
leads to a large diffusion coefficient D and thus to large fluctuations in Wt quantified 
by a small fi. Recall that the smaller fi is, the wilder are the fluctuations. 

Within an exact formulation, we have shown that there is a rather subtle phe- 
nomenon which identifles fi as the inverse of the typical value of the largest excursion 
against the flow of a particle in random motion with drift. This holds true for a large 
class of models characterized by a negative drift and a sufficiently fast repulsion from 
the negative domain (in the x- variable), i.e. from the origin (in the w- variable). 

3.3 Dynamical interpretation 

There are two ways to interpret the power law distribution we obtain. The first 
one is to generate an ensemble of multiplicative processes and, in practice, examine 
their values after a large number of multiplications. The power law then describes 
the distribution of the set of values thus obtained. The second interpretation is to 
consider the time evolution of a single constrained multiplicative process and examine 
the distribution of the values it takes over time. In the stationary regime these two 
distributions coincide. The models studied here correspond to the latter case. By the 
law of convolution, it is straightforward to check that the distribution of variations 
over one or more time steps of the variables is also a power law with the same 
exponent. 

At large t, wt thus does not converge but goes on fiuctuating as shown in figure 
2. What does converge is its distribution P{wt) — > Pooiwt) given by (|1^. wt is a 
dynamical variable distributed with a power law. As can be seen from eq.(|T^), the 



typical scale is set by wq for the refiecting barrier problem and by (6) for the Kesten 
variable. It is however clear from inspection of figure 2b that most of the time Wt is 
less than its average. It also shows rare intermittent excursions to much larger values. 
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3.4 Additional constraint fixing /i 

We recover the relationship relating /i to the minimum value wq in the refiecing barrier 
problem by specifying the value C of the average {wt). Calculating the average 
straightforwardly using (^^, we get {wt) = Wq-^^, leading to 

^^ = T^■ (30) 
^ c 

Notice that this expression is a special case of (|T7|) and should by no mean be inter- 
preted as implying that /i is controlled by Wq in general. This is only true with an 
addziiona/ constraint, here of fixing the average. The genera/ result is that /i is given 
by (0), i.e. at a minimum by the two first cumulents of the distribution of log A. 

3.5 Positive drift in the presence of an upper bound 

Consider a purely multiplicative process where the drift is reversed (log A) > 0, 
corresponding to an average exponential growth of Wt in the presence of a barrier wq 
limiting Wt to be sma/Zer than it. The same reasoning holds and a parallel derivation 
yields 

PUy^t) = (31) 

with /i > again given by (|1^. This distribution describes the values < < wq. 
Notice that, if /x > 1, the distribution is increasing with Wt- This is obviously no 
more a power law of the tail, rather a power law for the values close to zero. For 
/i < 1, Poo{wt) decays as a power law, however bounded by wq and diverging at 
zero (while remaining safely normalized). This shows that, when speaking of general 
power law distribution for large values, this regime is not relevant. Only the regime 
with negative drift and lower bound is relevant. 

However, in the case of Kesten variables (^), if St is growing exponentially with 
an average rate (log At) > 0, and if the input flow bt is also increasing with a larger 
rate r, we define bt = e'^^^^^^bt, where bt is a stochastic variable of order one. We also 
define Aj = Xte^. If r > (loga^), then (log At) < 0. 

The equation (1) thus transforms into St+i = XtSt + bt, with St = e^^St, and 
where Aj and bt obey exactly the conditions for our previous analysis to apply. The 
conclusion is that, due to input growing exponentially fast, the growth rate of Wt 
becomes that of the input, its average (which exists for /i > 1) grows exponentially 
as {St) ~ e'^* and its value exhibits large fluctuations governed by the power law pdf 
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P{St) ~ Jtttt with /i solution of (Af) = e^^, leading to /i = ^f2^L(^Att^ second 
order cumulant approximation. 

3.6 Transient behavior 

For t large but finite, the exponential (??) is truncated and decays typically like a 
gaussian for x > \fDt. Translated in the Wt variable, the power law distribution ([T^ ) 
extends up to Wt ~ and transforms into an approximately log-normal law for 

large values. Refining these results for finite t using the theory of renewal processes 
is an interesting mathematical problem left for the future. 

3.7 Non- stationary processes 

When the multiplicative process (|l]) is not stationary in time, for instance if f (t), Dit) 
or Xo(t) become function of time, then their characteristic time r of evolution must 
be compared with t*{x) = For "small" x such that t*{x) « r, the distribution 
P{x, t) keeps an exponential tail with an exponent adiabatically following ^(t), D(t) or 
Xo(t). We thus predict a power law distribution for Wt but with an exponent varying 
with V and D according to eq. (|ll],|l5]) . For "large" x such that t*{x) > r, the diffusion 



process has not time to reach x and to bounce off the barrier that the parameters 
have alreay changed. It is important to stress again the physical phenomenon at the 
origin of the establishement of the exponential profile: the repeated encounters of 
the diffusing particle with the barrier. For large x, the repeated encounters take a 
large time, the time to diffuse from x to the barrier back and forth. In this regime 
t*{x) > r, the exponential profile for P{x) has not time to establish itself since the 
parameters of the diffusion evolve faster that the "scattering time" off the barrier. 
The analysis of the modification of the tail in the presence of non-stationarity effects 
is left to a separate work. In particular, we would like to understand what are the 
processes which lead to an exponential cut-off of the power law in the Wt variable, 
corresponding to an exponential of an exponential cut-off in the x-variable. 

3.8 Status of the problem 

Levy and Solomon |I| propose that the power law ( p!^ is to multiplicative processes 
what the Boltzmann distribution is to additive processes. In the latter case, the 
fluctuations can be described by a single parameter, the temperature defined 
from the factor in the Boltzmann distribution e~^^. In a nutshell, recall that the 
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exponential Boltzmann distribution stems from the fact that the number f2 of mi- 
crostates constituting a macro-state in an equihbrium system is multiphcative in the 
number of degrees of freedom while the energy E is additive. This holds true when 
a system can be partitionned into weakly interactive sub-systems. The only solution 
of the resulting functional equation Q{Ei + E2) = Q{Ei)Q{E2) is the exponential. 

No such principle applies in the multiplicative case. Furthermore, the Boltzmann 
reasoning that we have used in section 2.1 is valid only under restrictive hypotheses 
and provides at best an approximation for the general case. We have shown that the 
correct exponent /i is in fact controlled by extreme excursions of the drifting random 
walk against the main "flow" and not by its average behavior. This rules out the 
analogy proposed by Levy and Solomon. 

4 Conclusion 

We believe we have clarified and generalized the mechanism found by Levy and 
Solomon [l| to obtain power law distributions from constrained multiplicative pro- 
cess. The basic mechanism resides in the competition between an average drift to 
zero compensated by a mechanism tending to restore the multiplicative variable to 
a finite value. This reminds us of the interplay between exponential sensitivity to 
initial conditions and nonlinear reinjection at the heart of chaotic behavior. We have 
presented an intuitive approximate derivation of the power law distribution and its 
exponent, using the Fokker-Planck formulation in a random walk analogy. Our main 
result is the explicit calculation of the exponent of the power law distribution, as a 
solution of a Wiener- Hopf integral equation, showing that it is controlled by extreme 
values of the process. For narrow distributions of the factors A's, /i reduces approxi- 
mately to the ratio of its first two cumulants. We have also been able to extend the 
initial problem to a large class of systems where the common feature is the existence 
of a mechanism repelling the variable away from zero. We have in particular drawn a 
connection with the Kesten process well-known to produce power law distributions. 
The results presented in this paper are of importance for the description of many 
systems in Nature showing complex intermittent self-similar dynamics. This will be 
addresses in a separate communication. 
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FIGURE CAPTIONS 



Fig.l : Steady-state exponential profile of the probability density of presence of 
the random walk with a negative drift and a refiecting barrier. 

Fig. 2 : a) A typical trajectory of the random walker at large times, showing the 
multiple refiections off the barrier, b) The time evolution of the Kesten variable 
defined by the equation (p^Of ) with at uniformely taken in the interval [0.48; 1.48] 
leading to /i ~ 1.47 according to (p!7|) and ht uniformely taken in the interval [0; 1]. 
Notice the intermittent large excursions. 

Fig. 3 : Reconstructed natural logarithm of the probability density of the kesten 
variable St as a function of the natural logarithm of S^, for 0.48 < < 1.48 and 
< 6^ < 1, uniformely sampled. The theoretical prediction /i ^ 1.47 from (|T^ is 
quantitatively verified. 

Fig. 4 : Generic form of the potential whose gradient gives the force felt by the ran- 
dom walker. This leads to a steady-state exponential profile of its density probability, 
corresponding to a power law distribution of the wt-^aiiahXe. 
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